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Abstract 

We give a polynomial-time dynamic programming al- 
gorithm for solving the linear complementarity prob- 
lem with tridiagonal or, more generally, Hessenberg 
P-matrices. We briefly review three known tractable 
matrix classes and show that none of them contains 
all tridiagonal P-matriccs. 



1 Introduction 

Given a matrix M G R nxn and a vector q G R™, the 
linear complementarity problem LCP(Af, q) is to find 
vectors w, z G R™ such that 



Mz = q, w, z > 0, 



w T z = 0. 



(1) 



It is NP-complete in general to decide whether such 
vectors exist [2]. But if M is a P-matrix (meaning 
that all principal minors — determinants of principal 
submatrices — are positive), then there are unique so- 
lution vectors w,z for every right-hand side q [TO] . 
It is unknown whether these vectors can be found in 
polynomial time [7]. 

The matrix M = (my)^-! is tridiagonal if mij = 
for |j — i\ > 1. More generally, M is lower Hes- 
senberg if mij = for j — i > 1, and M is upper 
Hessenberg if M T is lower Hessenberg; see Figure [TJ 

In this note we show that LCP(M, q) can be solved 
in polynomial time if M is a lower (or upper) Hes- 
senberg P-matrix. Polynomial-time results already 



Figure 1: A tridiagonal matrix (left) and a lower Hes- 
senberg matrix (right); the nonzero entries are en- 
closed in bold lines. 



exist for other classes of matrices, most notably Z- 
matrices pQ, hidden Z-matrices [6], and transposed 
hidden K-matrices [9] . Section |6] shows that none of 
these classes contains all tridiagonal P-matrices. 

For the remainder of this note, we fix a P-matrix 
M e R" xrl and a vector q e R". 



2 The optimal basis 

For B C [n] := {1,2,..., n}, we let Mb be the n x n 
matrix whose ith column is the ith column of — M 
if i G B, and the ith column of the n x n identity 
matrix /„ otherwise. Mb is invertible for every set B, 
a direct consequence of M having nonzero principal 
minors. We call B a basis and Mb the associated 
basis matrix. 

The complementary pair (w{B), z{B)) associated 
with the basis B is defined by 
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wdB) := <^ i 

\{M B q)i liiiB 



(2) 



1 



and 

Zi(B) 
for all i £ [n]. 



(M B q) x if i G B 
if i £ B 



(3) 



Lemma 2.1. For every basis B C. [n], the following 
two statements are equivalent. 

(i) The pair (w(B), z(B)) solves LCP(A/, q), mean- 
ing that w = w(B), z = z(B) satisfy (Qp. 

(ii) M B l q > 0. 

If both statements hold, B is called an optimal ba- 
sis for LCP(M, q). 

Proof. As a consequence of ([2]) and ([3]), w — w(B) 
and z = z(B) already satisfy w — Mz — q and w T z = 
0, for every B. Moreover, w, z > if and only if 
w(B), z(B) > 0; this in turn is equivalent to M B q > 
0. □ 

From now on, we assume w.l.o.g. that LCP(M, q) 
is nondegenerate, meaning that (M B q)i ^ for all 
B C [n] and all i G [n]. We can achieve this e.g. 
through a symbolic perturbation of q. In this case, 
we obtain the following 

Lemma 2.2. There is a unique optimal basis B for 
LCP(M, q). 

Proof. Let w,zbe solution vectors of LCP(M, q) , and 
set B := {i G [n] : Wi = 0}. Since w T z — 0, we have 
Si = if i € [n] \ B. Hence, the vectors w, z satisfy 



q = (I n I —M) 



= Mt 



w 



n]\B 



so w — w(B),z — z(B) follows. Hence, B satisfies 
statement (i) in Lemma 12.11 and is therefore an opti- 
mal basis. 

Uniqueness of w, z |10] implies via Lemma |2. II that 
(w(B), z(B)) — (w(B), z(B)) for every optimal ba- 
sis B. But then © and © show that (M B ^q) l = 
(M B q)i = for all i G B © B. Under nondegener- 
acy, there can be no such i, hence B = B. □ 



3 Subproblems 

For K C [n], let Mkk be the principal submatrix of 
M consisting of all entries TOy with i,j G K. Fur- 
thermore, let qx be the subvector of q consisting of 
all entries q^,i G K. 

By definition, the submatrix Mkk is also a P- 
matrix, and \jGY(Mkk > qx) is easily seen to inherit 
nondegeneracy from LCP(M, q). Hence, Lemma [2.21 
allows us to make the following 

Definition 3.1. For k G [n], B(k) C [k] is the unique 
optimal basis of LCP(M [fc p] , g [fe ]). 

We also set B(-l) = 5(0) = 0. 

4 The lower Hessenberg case 

Let M be a lower Hessenberg matrix. Then we have 
the following 

Theorem 4.1. For every k G [n], there exists an 
index £ G { — 1, 0, . . . , k — 1} such that 

B(k) = B(£) U{£ + 2,£ + 3,...,k}. 

Proof. If B(k) = [k], the statement holds with index 
I = -1. Otherwise, let £ G {0, 1, . . . , k - 1} be the 
largest index such that I + 1 ^ B(k). The matrix 
Mnurfc] is lower Hessenberg as well, which implies that 
the basis matrix M := -^[fc][fc] B ( fe ) associated with 
B(k) satisfies my = if i < £ < j; see Figured] 
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Figure 2: The basis matrix M — -^[fe][fe] B ( fc ) i n the 
tridiagonal and lower Hessenberg case if £ + 1 ^ Bk . 
We have M [m = M [m]B(k)n[e] . 

As a consequence, the system of k equations 

\k][k] B[k) x = q[k] (4) 



Mi 



2 



includes the I equations 

M lW] B (k)n[i] x W =?M- ( 5 ) 

Since B(k) is the optimal basis of LCP(Mrurw, grw), 
the unique solution S of ((3]) satisfies x > 0; see 
Lemma 12. H Vice versa, the unique partial solution 
X[l] > of subsystem © shows that B(k)n[l] = B(£), 
the unique optimal basis of LCP(M[£][£], q[i\). To- 
gether with the choice of £, the statement of the the- 
orem follows. □ 

We remark that a variant of Theorem 14.11 for upper 
Hessenberg matrices can be obtained by considering 
lower right principal submatrices Mkk- 

5 Polynomial- time algorithm 

A basis test is a procedure to decide whether a given 
basis B C [n] is optimal for LCP(AT, q). According 
to Lemma 12. 1[ a basis test can be implemented in 
polynomial time, using Gaussian elimination. In the 
sequel, we will therefore adopt the number of basis 
tests as a measure of algorithmic complexity. Here is 
our main result. 

Theorem 5.1. Let M £ W ixn be a lower Hessenberg 
P-matrix. The optimal basis B = B(n) o/LCP(M, q) 
can be found with at most ("J 1 ) basis tests. 

Proof. We successively compute the optimal bases 
B(-l),B(0),...,B(n), where B(-l) = B(0) = 0. 
To determine B(k), k > 0, we simply test the k + 1 
candidates for B(k) that are given by Theorem 14.11 
In fact, we already know B(k) after testing k of 
the candidates. This algorithm requires a total of 

ELi k = Ct 1 ) basis tests - D 

Using an 0(n 3 ) Gaussian elimination procedure, 
we obtain an 0(n 5 ) algorithm — this is certainly not 
best possible. Faster algorithms are available if M 
is a tridiagonal Z-matrix [5] or i^-matrix [H [3] , but 
to our knowledge, the above algorithm is the first 
one to handle tridiagonal (and lower Hessenberg) P- 
matrices in polynomial time. The case of upper Hes- 
senberg matrices is analogous, see the remark at the 
end of Section @] 



All upper and lower triangular P-matrices are hid- 
den Z |12j . meaning that linear complementarity 
problems with triangular P-matrices can be solved 
in polynomial time [6]. We can now also handle the 
"almost" triangular Hessenberg P-matrices. As we 
show next, there is a significant combinatorial differ- 
ence between the two classes. 

6 A tridiagonal example 

Let us consider LCP(M, q) with 
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This linear complementarity problem was found by 
a computer search, with the goal of establishing 
Lemma 16.21 below. It can be checked that M is a 
tridiagonal P-matrix, but not a Z-matrix (a matrix 
with nonpositive off-diagonal entries). To show that 
some other known polynomial-time manageable ma- 
trix classes fail to contain all tridiagonal P-matrices, 
we need a new concept. 

Definition 6.1. Let 0(M, q) be the digraph with ver- 
tex set 2^ and arc set 

{(£?, B © {i}) : B C [n],i e [n], (M B \h < 0}. 

This digraph was first studied by Stickney & Wat- 
son [TT]. Under nondegeneracy of LCP(Af, q), it has 
a unique sink that coincides with the optimal basis. 

Lemma 6.2. For M,q as in fTjJ), 0(M,q) contains 
the directed cycle {1,2,3,4} -> {1,2,3} -» {1,2} -> 
{2} -> -> {3} -> {3,4} -»• {2,3,4} -y {1,2,3,4}. 

We omit the elementary proof. This implies that 
M cannot be a hidden Z-matrix, since for such ma- 
trices, 0(M, q) is the acyclic digraph of some geo- 
metric hypercube in R™, with edges directed by a 
linear function [6]. For the same reason, the tridi- 
agonal P-matrix M T cannot be the transpose of a 
hidden K-matrix (a hidden Z-matrix that is also a P- 
matrix) j9] . We remark that Morris has constructed a 
family of lower Hessenberg matrices M G R" XTl such 
that 0(M,q) is highly cyclic for suitable get" 0. 
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7 Beyond Hessenberg matrices 

It is natural to ask whether LCP(A/, q) can still be 
solved in polynomial time if M is a matrix of fixed 
bandwidth (number of nonzero diagonals), or fixed 
half-bandwidth (number of nonzero diagonals above 
or below the main diagonal); see Figure [3] 



Figure 3: Matrices of bandwidth 5 (left) and right 
half-bandwidth 2 (right). 

Let M be of fixed right half-bandwidth t. General- 
izing Theorem 14. 11 one can prove that there are only 
polynomially many candidates for B(k), provided that 
B(k) has a t-hole, meaning that B(k) is disjoint from 
some contiguous t-element subset of [k] . 

The only subset of [k] without a 1-hole is the set 
[k] itself, and this is why the lower Hessenberg case 
t = 1 is easy. But there is already an exponential 
number of subsets of [k] without a 2-hole. Hence, 
the above approach fails for t > 2. It remains open 
whether there is another polynomial-time algorithm 
in the case of fixed (right) bandwidth. 
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